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ABSTRACT 

A research study is reported which investigated the 
influence of the variables of race (examiner and child race) and 
expectancy (high and low) upon the scoring of individual IQ tests. 
Video tapes of two children (one black, one white, 10 years old, in 
the 85 to 95 IQ range) being administered the Wischler Intelligence 
Scale for Children were shown to 32 practicing school psychologists 
for their evaluations. Half of the psychologists were led to believe 
the children were brighter than they actually were (high expectancy) ; 
the other half, that they were duller (low expectancy) . The 
expectancy and order of child presentation (high-black, high-white, 
low— white, low— black, etc.) were randomized. The results indicate 
that in the case of expectancy white and black examiners score 
children (white or black) in a similar manner; i.e. , in the direction 
expectancy. Expectancy has the most influence upon scores obtained 
when children and examiners are of the same race. The implications 
for psychological examiners are that expectancy of student ability 
has a predictable influence upon the IQ attributed to that student.. 
The question remains, however, as to whether such a small average 
difference in IQ scores has any educational significance. 

(Author/LH) 
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SUMMARY 



Although school psychologists spend a large proportion of 
their time in the administration of individual intelligence tests 
and important decisions regarding children are frequently based 
upon these tests, relatively little is known about contextu al 
variables such as race and examiner expectancy. Tacit admission 
that such variables may influence test restilts is common and 
most school psychologists are aware that obtained and potential 
IQ scores may differ, particularly with children of minority 
races and low socioeconomic status. Given the importance of the 
decisions made regarding children's educational futures and the 
social-racial ramifications of recent court decisions it would 
appear that investigation of contextual variables is germaine. 
This is the report of a study which investigated the influence 
of the variables of race (examiner and child race) and expectancy 
(high and low expectancy) upon the scoring of individual IQ 
tests. 

The procedure for this study was to video tape the WISC 
being administered to a white and a black child. Both of the 
children were in the 85 to 95 IQ range, were 10 years old, and 
presented subtest scores with a wide range of variance. The two 
resulting video tapes, each about an hour in length, were shown 
to thirty-two practicing school psychologists (16 black and 1 6 
white psychologists). The instinct ions given to the psycholo- 
gists were to evaluate the two children in their normal, pro- 
fessional manner. Half of the psychologists were led to believe, 
through the use of ficticious referral forms, that the children 
were brighter than they actually were (high expectancy) nnH the 
®kher half that the children were duller than their true IQs 
would indicate (low expectancy). The expectancy and order of 
child presentation (high-black, high-white, low-white, low-black, 
etc.) were randomized. The psychologists were not informed as 
to the real intent of the investigation until they had produced 
subtest and full scale scores for each of the two children. 

The results of the study indicate that in the case of 
expectancy white and black examiners score children (white or 
black) in a similar manner. When a psychologist is given reason 
to expect a certain level of performance from a child, either 
high or low, the results are in the predicted direction. In 
other words when a psychologist evaluates children who are 
thought to be of low potential , he is influenced to a signifi- 
cant degree in that direction. Expectancy has the most influ- 
ence upon scores obtained when children and examiners are of 
the same race. There seems to be a dimunition of the influence 
of expectancy when child and examiner are of different races. 
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The implications for psychological examiners, if the results 
from such an investigatory procedure can he extrapolated to the 
real world, are that expectancy of student ability has a pre** 
dictable influence upon the IQ attributed to that sjtudent. This 
influence is lessened when examiner and child are of differ ing 
race'. However, although statistical significance was present, 
the question remains as to whether such a small average differ- 
ence in IQ scores has any educational significance, * . 
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INTRODUCTION 



PROBLEM : It was the purpose of this project to attempt to 

answer two questions: First, what is the extent of the effect 

of experimental expectancy upon the behavior of the examiner 
when determining intelligence? Secondly, what is the extent of 
the effect of race of examiner as linked to race of students on 
the measurement : of intelligence? 

With recent mandatory special education legislation in many 
states (e.g., Florida, Indiana, Illinois, etc.), large numbers 
of children are being given individual intelligence tests to 
determine their eligibility for special class placement; admis- 
sion to special classes of various types often being based upon 
an arbitrary IQ score. The importance of accurate evaluations . 
cannot be overemphasized when they determine to such a large 
extent the type of educational program that an individual will 
receive for a period of at- least several years which may ulti- 
mately affect his adjustment and contributions to society. 

Further , with desegration of public schools and busing 
becoming more than nominal throughout the country, and with the 
relatively greater interaction and need for evaluation of both 
black and white -children, by specialists of both races, the prob- 
lems of reliable information being developed by these special- 
ists becomes crucial. ; i 

A more complete and objective awareness of the part 
expectation plays in the behavior of psychologists-, psychome- 
tricians , and educators, in itself, should contribute to more 
objective techniques in evaluating qlients. r 

Under ideal circumstances it would be possible that 
relatively direct relationships exist between expectation and 
subjective distortion on the part of evaluators. If - such is the 
case, simple mathematical corrections could be developed to com- 
pensate .for discrepancies in evaluations. However, it would 
seem more likely that techniques will have to be developed, for 
those portions of evaluative procedures most subject to distor- 
tion, that would enforce objectivity in evaluations. 

• In addition: to public school applications, it was expected 
that data resulting from- this study would have implications for 
higher education, vocational rehabilitation, and industry. 
Particular usefulness might be anticipated for the numerous 
Federal projects dealing with race, intelligence testing and 
programs involving minority groups. Recent court cases reviewed 
by Ross et al (1971) indicate the relevance of such an investi- 
gation to current social questions involving education and 
racial groups. 
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REVIEW OF LITERATURE : 

Experimental Expectancy Effects - Recently the attention 
of many educators and psychologists has been attracted to the 
phenomenon of experimental expectancy as it affects experimental 
variables. Perhaps most familiar is Rosenthal's Pygmalion In 
The Classroom . Though recently: criticized (Buckley , 19^57 "T 
Gephart, 1970; etc. ) the phenomenon of a "self fulfilling proph- 
ecy has yet to be experimentally refuted or to accrue suffi- 
cient support to be put forward in more than the form of a 
tentative hypothesis. 



.Rosenthal (1969) traces the history of experimenter 
expectancy to - and perhaps beyond - the early 1900's with the 
following illustrations: 



•Just about -the time Alfred Binet’ was. developing his 
test in Prance, there was taking place in Germany ! 

one of the longest, most thorough , and moat, famo us 
intellectual evaluations of the. century. That 
evaluation was of the alleged intellectual abilit ies ' 
of Clever Hans, the horse of Mr.' von Osten. Hans' 
considerable talents in the fields of linguistic, 
mathematical, and; musical analysis, it will be remem- 
bered, were contingent upon his. examiners' giving • 
him unwitting and subtle cues, cues which seemed to ‘ 
derive from his examiners' expectations that' Hans 
would accurately tap out with his foot < the answers 
to an amazing variety of questions (Pfungst, 1911; 

19o5)'. ; . .-:••••;••: V ". v-;:; : . A 

,. Although most of the earlier studies involved animal-, 
experimenter problems, investigations with human subjects began 
appearing in the literature during the late 1950' s, with the 
most often cited studies being conducted An the I960' s. 

Ekren (1962),: reports a distinction between examiners- 
administering the Block Design subtest of. the Wechsler Adult 
Intelligence Scale (WAIS.) to high achievers and low achievers.' 

WAIS scores shoved, as a result of reported procedure 
difficulties, no distinction between. subjects, the subjects • 
contrasted affective behaviors on the part of the examiners 
directly related to the expectations held by the examiners. An 
analysis of the subject's ratings .of their examiners'* behavior 
showed that when examiners were contacting subjects alleged to 
be earning higher grades they behaved in a more friendly ^ like- 
able, interested and encouraging manner, showed a more expres- 
sive face, etc..' Although no significant differences existed - 
in scores : in the Ekren -study, Gordon and Dure a (19I+8 ) reported 
substantial differences in IQ scores related to affect of the 
examiner. . . ,-jj .... . „ . ,, 



On the basis of the above studies, and several others, 
Rosenthal (1968) concludes ". . .it appears that (the WAIS) may 
not be susceptible to the effects of the examiner's expectancy 
• • • 

Further studies have been reported using the Rorschach 
(Masling , 1965; Marwit and Marcia, 1967; Straus3, 1968), the 
Taylor Manifest Anxiety Scale (Pflugrath, 1962), word association 
tests (Silverman, 1968) and several other instruments. In an 
analysis of 35 such experiments, Rosenthal concludes the proba- 
bility that the results could have occurred at random as one in 
several million. 

The most often cited study, and the one with most interest 
to educators is Rosenthal's (1966) study, which appeared in 
Psychologi cal Reports and provides the focus for Pygmalion In 
The Classroom . 

Rosenthal, using 18 classrooms in the San Francisco area, 
suggested to teachers that 20 % of the children showed, on the 
basis of a ''test for intellectual blooming," unusual potential 
for intellectual, gains. At the end of the experimental period, 
the "unusual" children (who had actually been selected at random) 
showed significantly greater gains in IQ (as measured by 
Flanagan's (i960) nonverbal test of General Ability) than did 
the remaining children in the control group. Rosenthal indicated 
that the effects of teacher expectancy were especially apparent 
among the younger children. 

In a study dealing with the effects of experimental expect- 
ancy on latency in word association tests, Silverman (1968) 
found that when examiners expected longer latencies they obtained 
longer latencies. Silverman found a significant tendency to 
commit scoring errors in the direction of the expectations, but 
holds there was evidence to suggest such scoring errors did not 
account for all the effect obtained. 

Rosenthal (1969) discusses an unpublished study by Bees 
done in 1967 wherein 60 teachers taught the meaning of a series 
of symbols to preschool children. Half the teachers had been 
led to expect good symbol-learning and half had been led to 
expect poor symbol learning. Assessment of the children was on 
the basis of an examination by a. "blind" examiner who did not 
know what the child's teacher had been led to expect of the 
child's learning ability. Rosenthal maintains that the results 
of this study strongly support the concept of the effectiveness 
of teacher expectancy, since the probability of the discrepancy 
being due to chance was less than .000002. 



Rosenthal points out that a logical explanation vould be 
that the teacher's expectations of superior learning gave incen- 
tive for superior teaching. When an attempt was made to consider 
the data, holding constant for teaching behavior, the effect of 
expectancy was diminished, but still significant. The "teaching 
benefits" for which an attempt was made to control, in this case, 
seemed to be limited to the number of symbols taught rather than 
differences in teaching style. It would appear that teaching 
style and skill would be as important, in measurements of this 
sort as the number of concepts the teachers attempted to teach. 

In a similarly designed study treating the effect of 
teacher expectancy as social acceptance rather than IQ, Jacobs 
(1970) found no significant difference between experimental and 
control populations . 

Rosenthal (1969) also discusses an unpublished experiment 
by Larrabee and KLeirisasser (1967 ) in which five examiners 
administered the Wechsler Intelligence Scale for Children to 12 
sixth-graders of average intelligence. Each subject was tested 
by two different examiners; one examiner administering the even- 
numbered items and the other examiner administering the odd- 
numbered items. For each subject, one of the examiners was told 
the child was of above average intelligence while the other 
examiner was told the child was of below average intelligence. 
When the child's examiner expected superior performance the 
total IQ earned was 7 • 5 points higher on the average than when 
the child's examiner expected inferior performance. When only 
the performance subtests of the WISC were considered, the 
advantage to the children of having been expected to do well 
was less than three IQ points and could easily have occurred by 
chance. When only the verbal subtests of the WISC were consid- 
ered, the advantage of having been expected to do well, however, 
exceeds 10 IQ points. The particular subte&t most affected by 
examiners' expectancies was Information. The results of this 
study were especially striking in view of the very small sample 
size (12) of subjects employed. 

Again, however, no mention was made of systematic errors 
which might unintentionally have been made by the examiners. 

This seems particularly striking when it is noted that the scores 
reflecting the greatest discrepancy were the verbal portions of 

the WISC requiring the greatest degree of examiner judgment in 
scoring. 

Rac£ Effects - Despite the controversy precipitated by 
Jensen (1°69) regarding IQ and race, the most plausable response 
to the problem appears to be that the question cannot be answered 
in present circumstances (Bodmer and Cavalli-Sforza, 1970). 

Indeed, Havighurst and Heugarten (1962) said much the same when 
they suggested that 'most anthropologists and psychologists now 



believe that there is no innate difference in intelligence 
between racial or ethnic or religious groups. There cure innate 
differences between individuals within these groups, but the 
average intelligence of the groups is the same, it is thought, 
if the groups have equal opportunity and similar training in 
solving the ordinary problems of life. '' 

Thorndike and Hagen (1955) state that the most widely used 
individual tests are tests of intelligence. They point out that 
"An IQ of 90 has a rather different meaning for a Negro child 
who spent his early years in a sharecropper's cabin ip the rural 
south from what it has for the son of a local banker." 

In a comprehensive review of the literature, Sattler and 
Theye (1966) point out the weaknesses of previous research, sug- 
gesting that most of the studies used only one or no black 
examiners compared to a great many white examiners. These 
reviewers also suggested design, sampling, and statistical 
problems inherent in many of the studies. Levy (1956) suggested 
designs involving analysis of variance should be attempted in 
order to facilitate meaningful interpretation: to date, these 

suggestions have not been implemented. 

Of particular relevance to the present project was 
Goodenough's (19^0) early discussion of the possibilities of 
systematic errors in test administration and in test scoring. 
Sacks (1952) for example, found differences in test results on 
the Stanford-Binet related to the relationships established 
between examiner and subject. In this study, differences were 
attributed to improved or deteriorated performance on the part 
of the subjects and differences due to scoring or interpretation 
by the examiner were not considered. 

Within the general field of psychological evaluation 
(Masland et al, 1958; Valett, 1963; White, 1961) it is common 
practice for authorities to urge practicing psychological 
examiners to consider the student variables of race and socio- 
economic status. The usual rationale for this is that the 
psychologist may estimate intellectual potential as opposed to 
the obtained or indicated test scores. Nalven et al (1969) 
found that "a child's social class background, to a great 
extent, and his race, to a lesser extent significantly shape 
psychologists' judgments as to whether his obtained IQ scores 
are representative." Although this study looked at student 
race and WISC IQ score relationships, examiner race was not 
considered. 
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METHODS 



jKSTRUMEHT; The Wechsler Intelligence Scale for Children was 
the individual intelligence test used in this study. Each 
examiner was asked to score, in the manner described below, the 
Information, Comprehension, Arithmetic, Similarities, Vocabu- 
lary, Picture Completion, Picture Arrangement, Block Design, 
Object Assembly, and Digit Symbol subtests (all but Maze's). 

Each examiner was required to complete the calculation of the 
verbal, performance and full scale intelligence quotients, 
having been given the birth date of the individuals to be scored 
and the date of the testing. 

SUBJECT EXAMINERS : The examiners were thirty-two individuals 

fully trained, certified and experienced in the administration 
of the WISC. The examiners were selected from the staffs of 
public school districts, public and private agencies. Included 
were school psychologists, clinical psychologists and psychome- 
tricians. Sixteen of the examiners were Negroid and sixteen 
were Caucasoid. Attempts were made to stratify the examiner 
sample so that examiner characteristics would correlate well 
with the National Survey of School Psychologists (1971); 

Factors considered to be relevant here were examiner sex, age, 
experience, type of employment and level of prof e s s i onal 
preparation. . - 

STUDENTS : Two male children, one black, one white, were used 

as the students whose responses on the WISC were scored by the 
subject examiners. The students were both ten years old and 
had. IQ's, as recorded in their school records, within the 80 to 
90 range. Students in this range were selected since according 
to Jacobs and others (1967.) (Cunningham and others, 1969), it 
is from this group that children are most often erroneously 
assigned to special education classes and it is with children 
in this IQ range that teachers most often experience difficulties 
in such areas as academic success, emotional problems, absentee- 
ism, and attention seeking. Both of the students' WISC profiles 
were characterized by a good range of variability within the 
subtest scores. 

PROCEDURES : Examiners were invited to participate in an 

experiment involving the use of TV tape for the scoring of intel- 
ligence tests. It was,- when, necessary, explained further that 
the study was designed to attempt to eliminate* systematic errors 
in test administration through the use of TV tape and as a poten- 
tial teaching device for use with psychologists in training. At 
the conclusion of the testing, the complete purpose was more 
carefully explained to the participants and they were asked not 
to discuss the full nature of the' study to other potential par- 
ticipants. Each examiner received an honorarium of $100 for 
his participation in the study. 

9 
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A production quality TV tape was made of each student as 
he took the WISC. The WISC was administered by a qualified, 
experienced psychologist who did not appear on the TV tape but 
was heard administering the test.- The resulting tapes were each 
less than an hour in length. Average examiner time required to 
complete the entire testing and scoring task was a little over 
three hours. As a lead to each tape one of two fictitious case 
histories (see Appendix A) of the child was read by the subject 
examiner resulting, in effect, in four different presentations 
consisting of a case description followed by the test adminis- 
tration. One case description presented the subject as coming 
from a middle class home, as having a history of doing well in 
school, liking school and his teachers. This was followed by 
the administration of the WISC. The second case description 
presented a case study wherein the subject was depicted as coming 
from an impoverished, low income area, as doing poorly in school, 
and as disliking his school and his teachers. This was followed 
by the segment depicting the administration of the WISC. 

Each subject-examiner individually viewed and scored two 
tapes; one of a black and one of a white student. Whether the 
particular referral was of a student presented as having done 
well or poorly in school and whether a black student or a white 
student was seen first, was randomly determined. 

During their viewing of the two test administrations, each 
examiner was provided with all of the equipment necessary to 
score the test;- scoring protocols, stopwatch, manual, etc. 

Copies of student completed Coding subtest of the WISC were 
reproduced and available to the examiner. After all test scoring 
was completed the examiners were asked to respond to a brief 
questionnaire (see Appendix B) which included demographic ques- 
tions as .well as questions about the usefulness of the video 
tape procedures. 

STATISTICAL DESIGN ; Basically, the major analysis of the data 
is a. plot x treatment, 2 x 2 x 2 factorial analysis of variance 
(Mendenhall, 1968; 1969)* on each subtest as well as on the 
verbal, performance, and overall IQ scores (see Figure I). 
Significance in this study is defined at the .05 level of 
confidence . 
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HYPOTHESES ; The hypotheses to be tested were : 

^ ere is no significant difference in IQ scores of 
Negro subjects when the test is scored by Negro, or 
Caucasian examiners. 

2. There, is no significant difference in IQ scores of 
white subjects when the test is scored by Negro or 
Caucasian examiners. 

3. There is no significant difference in IQ scores when 
examiners believe a subject does well in school and 
when examiners believe a subject does poorly in school. 

U. There are no significant interactions between race 
of subject, race of examiner and/or expectancy on 
the IQ score. 
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RESULTS 



EXAMINER CHARACTERISTICS ; Self report data obtained from the 
examiners after they had finished scoring both students, indi- 
cates that the examiners mean age was 37 and their mean number 
of years experience as a school psychologist was 4.5. Nearly 
all the examiners were at the masters level in terms of academic 
preparation (28 of 32) and they averaged 117 individual psycho- 
logical evaluations per year in their present employment. The 
examiner subjects were balanced (50-50) in terms of sex as well 
as race. The sample favored large urban school districts over 
suburban and county districts by a two to one margin. All but 
three examiners scored the video tapes as requested without 
skipping any subtests. In the cases of the three who objected 
to one or more subtest inclusion in the Full Scale IQ, they were 
requested to finish the subtest as best they could in spite of 
what they considered to be an error in test administration. 

Thus all data cells were completed for purposes of data analysis. 

The major analyses in the study consisted of a factorial 
Analysis of Variance on the intelligence quotients (Full scale. 
Verbal and Performance) derived by the subject examiners followed 
by analysis of subtest scores. Factors considered in the analy- 
sis of variance were race of subject, race of examiner and 
expectancy and the first and second order interactions of these 
factors . 

FUEL SCALE : The results of the analysis of variance of fu ll 

scale scores are presented in Table I. Using the data presented 
in Table I, the following inferences are drawn. : 

A. There was no significant difference in the scoring of 
the WISC between the black and white subject examiners 
(mean Full Scale IQs were 88.8 and 88.6 respectively). 

B. There was no significant difference in the Full Scale 
IQs of the students (white student's = 88.6, black 
student's = 88.6). 

C. There was a significant (P < .05) difference in Full 

Scale IQ between the high expectancy (IQ = 98*6) and 
low expectancy (IQ = 87.9) conditions, suggesting the 
positive expectations developed in the student's 
referral form affected the scoring of the WISC by the 
subject examiners. . . 

D. None of the first order interactions approached 
significance. 
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Table Is 



Factorial Analysis of Variance of Full Scale 
Wechsler Intelligence Scale Scores 

SOURCE __ _ SS ' • df ms F 



TOTAL 79I* 63 

Between Subjects 215 15 - 

Race of Examiner .5626 1 .5626 .0367 ns 

Error b - 21U.U37 1 * lU 15.317 - 

Within Subjects 579 1*8 - - • 

Race of Subject 1 1 1 .0539 ns 

Expectancy 1*2.25 1 1*2.25' 5.0909 <;05 

Race of Examiner X 

- Race of Subject 5.062U 1 5.0621* .2727 ns 

Race bf Examiner X 

Expectancy 3.O62U 1 3.O62U .3690 ns 

Race of Subject X 

Expectancy 9.0000 1 9. 0000 1.151U ns 

Race of Examiner X 

Race of Subject X 

Expectancy 33.0626 1 • 33.0626 U.2296 <.10 



Error 1 
Errorg 
Error ^ 



259.938 ll* I8.567 
116.188 ’ ll* 8.2991. 

IO9.U36 ll* 7.8169 



E. The second order interaction, race of examiner X race 
of student X expectancy approached (P < .10) but failed 
to achieve significance. This interaction is shown in 
Figure II. It should be noted that expectancy seems 
to’ have its most dramatic effect , in the predicted 
direction, when examiners are evaluating students of 
their own race. There is.no apparent effect when 
examiner and subject are of a different race. 

VERBAL SCALE : The analysis of the verbal scale is presented in 

Table H. As in the analysis of Full Scale Scores, only the 
factor of expectancy achieved significance (P < .001). However, 
both race of student and the second order interaction of race 
of examiner X race of student X expectancy (see Figure III) 
approached significance. It is interesting to note that on the 
verbal portion black examiners score high expectancy white 
students lower than low expectancy students. 

On the Verbal scale, as on the ’'Full' Scale', expectancy 
differences were much greater in the predicted direction, when 
exa mi ner and student were of the same race . When examiner and 
student were of a different race, the magnitude of the effect 
was greatly dimished and, in fact, was not . in the predicted dir 
direction for black examiner scoring white students 1 




Figure II: Full Scale IQ Shoving Race of Examiner X Race of 

Subject X Expectancy (P < .10) Interaction 



Table II : Anova .» Verbal 



SOURCE SS df ms F 



TOTAL 


1201.73UU 


63 








Between Subjects 


331.90UU 


15 








Race of Examiner 


.11*07 


1 


.11*07 


.0059 


ns 


Error^ 


331.81*5 


ll* 


23.7032 


■- 


- 


Within Subjects 


869.75 


1*8 


■ ^ 






Race of Subject 


92.61*07 


1 


92.61*07 


3.5905 


ns 


Expectancy 
Race of Examiner X 


125,7969 


1 


125,7969 


26.5087 


<.001 


Race of Subject 
Race of Examiner X 


21.3905 


1 


21.3905 


.8290 


ns 


Expectancy 
Race of Subject X 


.0158 


1 


.0158 


.0033 


ns 


Expectancy 
Race of Examiner X 
Race of Subject X 


6.8905 


1 


6.8905 


.6112 


ns 


Expectancy 


37.5158 


1 


37.5158 


3.3275 


ns 


Error^ 


361.2182 


ll* 


25.8013 






Error 2 


66.1*373 


ll* 


1*. 71*55 






Error g 


157.81*1*3 


ll*. 


11.271*6 
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PERFORMANCE : When scores on the Performance portion of the WISC 

were analyzed, significant differences were noted for race of 
student as well as for expectancy (see Table III). Performance 
IQ for the white student was 90.3 and for the black student 
88.1 (P < .03). Performance IQ under the condition of high 
expectancy was 9 0.0 and low expectancy was 88.3 (P < .05) . 

It can be assumed the difference found for race of st ud ent 
was an actual difference in the performance of the two students. 
However, the difference in expectancy (P < .05) can only be 
attributed to experimental treatment differences . None of the 
interactions on Performance approached significance. 

It can be seen from Figure IV, the phenomenon noted on the 
Full Scale and Verbal portions, of magnification of expectancy 
effect when student and esscminer are of the seme race, is 
present on the Performance protion of the WISC, though not of 
as great a magnitude. 

SUBTEST SCORES ? The analysis of variance tables for subtest 
scores are included in the appendix (see Appendix C). Each 
subtest is discussed below. - 

Information - The analysis of variance on the Information 
subtest scores indicates a significant difference (P. ( .001 ) 
between the black and white student . Race of examiner and 
expectancy both approached (P < .10) significance. 
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Table III: Anova = Performance 



SOURCE 



TOTAL 


8 U 5 . 109 U 


63 








Between Subjects 


178.359** 


15 


— 






. Race of Examiner 


3.5157 


1 


3.5157 


.2815 


ns 


Error. 

D 


174.8437 


14 


12.4888 


- 


- 


Within Subjects ’ 


666.75 


48 








Race of Subject 


78.7657 


1 


78.7657 


6.1831 < 


.03 


Expectancy 


47.2657 


1 


47.2657 


5.9766 <.05 


Race of Examiner X 


Race of Subject 
Race of Examiner X 


.1405 


1 


.1405 


.0110 


ns 


Expectancy 
Race of Subject X 


8.2655 


. 1 


■8.2655 


1.0451 


ns 


Expectancy 


9.7655 


1 


9.7655 


.6316 


ns 


Race of Examiner X 
Race of Subject X 


Expectancy 


17.0158 


l 


17.0158 


1.1005 


ns 


Erro^ 


178.3438 


14 


12.7388 






Error 2 


110.7188 


l4 


7.9085 






Err or 3 


216.4687 


14 


15.4621 


- 


- 




Figure IV : Performance 



Comprehension - As on the Information subtest, there was 
a significant (P < .01) difference between the black and white 
students on Comprehension (white students means scaled score' = 
69.O ; black students = 50.0). The interaction race of student 
X race of examiner approached (P < .10) but failed to achieve 
significance. 

Arithmetic- — On the Arithmetic subtest, the second order 
interaction, race of student X race of examiner X expectancy 
was highly significant (P < .001). Figure V illustrates this 
interaction. Race of examiner X expectancy approached (P C .01) 
significance. 




Similar i ties — On the Similarities subtest, only race of 
student achieved significance (P < .0001) . The black student 
had a mean scaled score of 10.97 and the white student a mean 
scaled score of 8 . 0 . The race of examiner X race of student 
(P < .10) interaction and the race of student X expectancy 
(P < . 06 ) interaction both approached significance. 

Vocabulary - There was again a significant (P < .001) 
difference between black and white student's Vocabulary, the 
black student having a mean scaled score of 10.0 and the white 
student a 7 . 5 * Race of examiner approached (P < .10) signifi- 
cance, with black examiners scoring the vocabulary It ems lower 
and white examiners scoring higher. 
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Digit Span - There was a significant difference (P < .05) 
in expectancy in the Digit Span subtest: Mean scaled score 

under the condition of high expectancy was 6.18 and for low 
expectancy 5*875. The race of examiner X expectancy inter- 
action approached (P < .10) significance. 

Picture Completion - Only the race of student provided a 
significant difference (P < .001) on the Picture Completion 
subtest. The white student had a mean scaled score of 6.1*3 and 
the black student 10.78. 

Picture Arrangement - Again, only the race of student 
provided a significant (P < .001) difference. Mean scaled 
score on the Picture Arrangement subtest for the white student 
was 51.0 and for the black student 7.13. 

Block Design - The black student had a mean scaled score of 
9.2 on the Block Design subtest and the white student a mean 
scaled score of 10.1. This difference was highly significant 
(P < .001). None of the interactions approached significance. 

Object Assembly - As with most of the performance subtests, 
the only significant factor (P ( .001) in the analysis of the 
Object Assembly subtest was the race of student. In this case 
the mean scaled scores were: white student = 10.53 and black 

student = 7*56. 

Coding - The Coding subtest provided significant differences 
in race of student (P < .001), expectancy (P < .05), and race 
of examiner X expectancy (P < .05). Mean scaled score for the 
white student was 9.6 and for the black student 6.8. Under the 
condition of high expectancy the mean scaled score was 8.53 and 
under low expectancy was 7.9. The interaction (race of examiner 
X expectancy) is shown in Figure VI. Expectancy seemed to 
exert a significantly greater influence on the scoring of the 
Coding subtest by black examiners than by white examiners. As 
has been previously suggested this phenomenon is especially 
apparent when scoring subjects of different races. 



High 

Expect- 

ancy 


White Student 
Black Student 

Mean SS 


• WHITE EXAMINER 

9.75 

6.75 

8.25 


BLACK EXAMI1 
10.25 
7.5 

8.81 




White Student 


9.625 


9.125 


Low 


Black Student 


6.875 


6.00 


Expect- 








ancy 


Mean SS 


8.25 


7.56 



Figure VI : Race of examiner X expectancy on 'Coding subtest 

Numerals represent mean subtest scaled scores. 



CONCLUSIONS 



On the basis of the data analyzed in the present study, 
the following conclusions can be drawn: 

1. There is no evidence to support the hypothesis that 
Negro examiners score white students differently than Caucasian 
examiners. 

2. When considering only main effects there is no 
evidence to support the hypothesis that Caucasian examiners 
score black students differently than Negro examiners. 

Previous research of questionable design has reported 
students performing differently as a function of race of exami- 
ner. Performance of examiners as a function of race of examiner 
and/or race of student has not- been reported. The race of 
examiner X race of student interaction was not significant in 
any of the analyses performed: Full Scale, Verbal, Performance 

nor any of the subtests. 

3. Expectancy had a significant effect on the scores 
derived by the examiners. When the psychologists were led to 
expect high achievement and ability in the child being tested 
the scores were significantly higher than when they were led to 
expect low ability achievement. Expectancy had a significant 
effect on Full Scale IQ, Performance IQ and Verbal IQ. The 
difference between high and low expectancy condition scores was 
especially apparent in the Verbal portion of the V7ISC (achieving 
an F of 26.5 with 1 and l4 degrees of freedom; P .001) 
suggesting that the Verbal scale is more subjective than the 
Performance scale. 

This finding should be considered when, for example, the 
Larrabee and Kleinsasser (1967) study is evaluated. Larrabee 
and Kleinsasser found, with individually administered WISCs, an 
elevation of performance of the students on the Verbal portion 
under conditions of positive expectancy. However, no attempt 
would seem to have been made to control for the effect of posi- 
tive expectancy in the scoring behavior of the examiners. 

4. Apparently the most meaningful interaction considered 
was race of examiner X race of student X expectancy. The data 
suggest that expectancy has its most noticeable effect when 
examiners are testing children of their own race. When white 
examiners scored black students or when black examiners score 
white students, the effects of expectancy were diminished. This 
effect, of course, would tend to reduce the main effect of 
expectancy and would suggest the reexamination of relevant 
expectancy studies when race was not controlled for. 



RECOMMENDATIONS 



The results of this investigation seen to suggest that 
differences between black and white psychologists on the scor- 
ing of black and white students is minimal. In view of this, it 
is suggested that those psychologists (e.g., Williams, 1970) 
contending that only black psychologists be used in the evalua- 
tion of black subjects may want to reconsider their position 
in light of empirical data. This recommendation would seem 
especially germane in light of the tendency of the psycholo- 
gists in the present study to be more Influenced by variables 
other than performance in the examining situation when deal- 
ing with children of their own race. It is also recommended 
that a similar investigation be undertaken with evaluations 
of personality variables using projective techniques; tech- 
niques reportedly more susceptible to subjective unreliability. 

Although the magnitude of difference between high and 
low expectancy conditions would not seem to be educationally 
Important, it must be remembered that the laboratory condi- 
tions of the present study may have minimized expectancy dif- 
ference which may be found under field conditions. It would 
seem Important that consideration be given to the following 
recommendations when results of intelligence testing may have 
dramatic effects on the subject; as when the subject is being 
evaluated for institutionalization or removal from regular 
academic situations for placement in special classes for the 
retarded. 



1* The use of 'blind * evaluations by another psycholo- 
gist or psychometrician who is not familiar with the reason for 
referral; with interpretation of the results then being made by 
the psychologist who can Integrate the findings into a know- 
ledge of other relevant variables before making recommendations. 

2. The testing only of ’’other race’’ students (since 
the effect of expectancy appear©) to be minimized under these 
conditions) . 

It is the opinion of the investigators that the most 
Important finding of the study is the remarkable similarity of 
IQ scores derived for the two students by dissimilar examiners. 
This would suggest, if the sample studied was representative 
of the general population and if the evaluation procedure is a 
valid measure of school psychologists' "in the field" behavior, 
then students are being reasonably accurately assessed regard- 
less of race. 
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Furthermore, the actual procedure of video presentation 
of students for psychological evaluation has much to offer in 
terms of an examiner training and standardizing technique. It 
is recommended that college and university programs involved in 
the preparation of psychologists for the evaluation of children 
consider the potential of. this technique for inclusion, in their 
training programs. 
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APPENDIX A 
Referral Forms 




XXXXXXXXXX PUBLIC SCHOOLS 
PSYCHOLOGICAL SERVICE REFERRAL FORM 

Name Lenny XXXXXXX Date October 1« 1971 

Address XXXXXXXXXXXXX Phone XXX XXXX 

School Marquette Elementary Grade Hh Birthdate 9 /U /61 

Teache r Mrs. Gloria Simmons Principa l Mr. Frank Crowell 

Reason for referral (State the problem briefly) Lenny is being 
considered for the advanced fourth grade room. He is a hard 
worker and deserves the chance. At a recent staff meeting it 
was agreed that we need an outside opinion on how to deal with 
the special sort of problems which he presents for placement. 
FAMILY . , Name Address Occupation 

Fathe r . George ' ' '• mmXXXXXX Painter 

Mothe r Roberta mXXXXXXXXX Housewife 

Number of childre n U~~ Position of child in family group 3 
Comments on family (Marital status , others living in house , 
etc . ) Lenny comes from a perfectly wonderful family . The 
parents have been very cooperative with the school and seem to 
be supportive with him. The parents report that the entire 
family works together on school assignments. - - 

HEALTH: . . . - v • . . v." — 

Name of family physician Dr. E. L. Russell Comments on 
physical problems (vision, hearing, coordination , etc . ) Perfect 
as far as school is concerned. He excels' in all sorts of 
physical activities and ~ is a leader of the other children on 
the playground. 

Has pupil been seen by the Child Guidance Clinic or other 
agency? No If yes, please attach report to this form. , 
TESTING INFORMATION 

* ' ; • INTELLIGENCE TESTS (individual or Group) 

Date Test Grade when given CA MA IQ Other Result s 

69 Peabody 2nd 8 9-7 113 



ACHIEVEMENT TESTS. .. Other 

Date Test Grade when given Age Read. Level Arith . Level Results 

68 Iowa 1st 7 2.3 , 2.7 

70 Iowa 3rd : 9 ^*.8 4,9 . - 



1. Make out in duplicate. Send original copy to Office of 
Pupil Personnel Services , Administration Building. 

2. Use reverse, side for supplying any additional information. 

3. Referral assigned to Da.te /Qr ~f'. *-/. if 

(To be completed by Office, of Pupil Personnel Services X ; ; 



XXXXXXXXXX PUBLIC SCHOOLS 
PSYCHOLOGICAL SERVICE REFERRAL FORM 

Name . Lenny XXXXXXXXX Dat e October 1> 1971 

Address XXXXXXXXXXXXX Phon e XXX XXXX 

Schoo l Marquette Elementary . Grade Uth Birthdat e 9/U/6l 

Teacher ' Mrs. Gloria Simmons Principa l Mr. ' Frank Crovell 

Reason for referral (State the problem briefly) Lenny is so 
far behind the r est he is a very real problem to himself and 
the oth er children. I question the results of the Kroup tests 
and the wisdom of his continuing in the regular grades. Indi- 
Y_i .dual testing . I am sure, will indicate the proper placement 
for him T ' ' , — — 

FAMILY Name “ Address " ■ . Occupation 

Fathe r George XXXX XXXXXXXX Janitor 

Mother Roberta XXXXXXX XXXXX Housewife 

Number of children 4 Position of child in family group _3 
Comments >on family (Marital status, others living in house, 

® tc • ) Lenny *s family seems -to care little for him' or his 
problems. Other youngsters from this family have received 
similar t reatment when they experienced academic difficulties. 
The pare nts seem to have enough trouble of their own with him 
and won’t li sten ..to . Ms regarding school problems. 

HEALTH ■ n — ... ■ 

Name of family physicia n Dr. E. L. Russell Comments on 
physical problems (vission, hearing, coordination, etc. ) There 
are no recor ds of any major problems. I observe,- however, 
that he is usually very tired and he is one of the most acci- 
dent prone' children I have ever had in my class. 

TESTING INFORMATION . ... ' : . . .. 

_ INTELLIGENCE TESTS (individual or Group) 

Date Tes t Grade when given. CA . MA . IQ.: Other Results 

69 Peabody 2nd 8 5-8 72 



..... . . ACHIEVEMENT TESTS ...C. Other 

Date Test Grade when given Age. Read.. Level Arith. Level Results 

68 Iowa 1st 7 Kg. 2 Kg. 3 

70 Iowa 3rd 9 ,v 1.6 ^ 1.6 7“~ 



1. Make out in duplicate. Send original copy to Office of 

Pupii_ Personnel Services , Administration Building. '. ’ 

2. Use reverse side for supplying any additional information. 

3. Referral assigned t o Pat e^cf, V, 7/ 

(To be completed by Office of Pupil Personnel Services) 



XXXXXXXXX PUBLIC SCHOOLS 
PSYCHOLOGICAL SERVICE REFERRAL FORM 

Nam e Gary XXXXXXXXX Dat e Spetember 2U , 1971 

Address XXXXXXXXXXXX Phone XXX XXXX 



Schoo l Burton El.: Grad e Uth Birthdate 12/3/60 

Teacher Mrs. Priscilla Duncan Principl e Mr. David Jarvis 

Reason for referral (State the problem briefly) I am convinced 
that Gary would be better placed in the advanced section of 4th 
grade. His parents and I agreed to let an outsider evaluate 
him and to be the .judge of such a placement. Gary is a warm 
and helpful person in the class. I want to do all I can to let 



him use his high potential. 

FAMILY Name Address Occupation 

Father Floyd __ . XXXXXXXXXX General telephone 

Mother Margaret XXXXXXXXXX Housewife 



Number of childre n U Position of child in family group 2 
Comments on family” (Marital status, others living in house, 
etc . ) Gary’s family is well thought of in -the community and 
at school. I had his older sister (a fine student) tow years 
ago so I have a good relationship with the family. 

HEALTH: ^ — 

Name of family physicia n Dr. Wm. McCarthy Comments on 
physical problems (vision, hearing, coordination, etc.) No 
known physical or emotional problems. Gary is a very hard 
worker and is very anxious to please the teacher. I sometimes 

think he is too eager to please..: 

Has pupil been seen by the Child Guidance Clinic or other 
agency? No If yes, please attach report to this form. ; 
TESTING INFORMATION V; /T 

INTELLIGENCE TESTS (individual or Group) 
Date Test Grade when given CA MA IQ Other results 
69 Pea- 2nd 9-s m ~ “ • ' “ “ 

body ■ p’ ^ 



- • - ACHIEVEMENT TESTS Other 

D ate Test Grade when given Age Read. Level Arith. Level Results 

68 Iowa 1st 7 2.4 2,9 

70 Iowa 3rd 9 U.7 5.1 



1. Make out in duplicate. Send ori ginal copy to Office of 
Pupil Personnel Services, Administration Building. 

2. Use reverse side for supplying any additional information. 

3. Referral assigned t o^^r ^ - ■ Dat e <€S$#>27,7J 

(To be completed by Office of Pupil Personnel Sei/vi^esV 



- 4 
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XXXXXXXXX PUBLIC SCHOOLS 
PSYCHOLOGICAL SERVICE REFERRAL FORM. 

Name Gary' XXXXXXXXX ' * * Date September 24, 1971. 



Address XXXXXXXXXXXXX : . ..Phone XXX XXXX 

M. • 

School _____ Burton E . : v -y v Grad e 4th Birthdat e 12/3/60 
Teache r Mrs; Priscilla Duncan - ' r - Principa l Mr. David "Jarvis 



Reason for referral (State the - problem briefly) Gary is in 
severe academic difficulty-. -His level of competence is w»n 
below that of others in thee lass room. Because of this he is 
a constant source of disruption which hurts the other children 
. as veil as himself » I think he cheats on group tests. He. 
needs help from someone other than myself. ... 

FAMILY Name Address Occupation 

. Father Floyd • XX XXXXXXXX Gas Station' ; 

Mother Margaret XXXXXXXXXX Housewife 

Number of children 4 Position of child;. in family group 2 
Comments on family (Marital status, others living in house; 
etc . ) • Gary was very likely an unwanted child like his younger 
• siblings.' The- family (if that's what you call it) seems to 
rim in all directions at - onc'e -as the parents offer little^ 
direction over or concern for the children. All of the child- 
ren have had difficulties- in school and some are in special- 
classes. tv: nor-. , ■ •; •••;. : .*•; • :uy • 

■ .HEALTH: . ... ..v'*'-'-' 

Name of family phys i c i a n - Dr; Wm. McCarthy - Comments on 
. .Physical problems (vision; hearitig, coordination, etc; ) -Gary 
is always tired and 'has a running nose. Although he is not 
sick; he sure seems anemic or something. ' Sometimes I wonder 

if- he hears me when I speak to' him. . ■ 

Has pupil been seen, by the Child Guidance Clinic or other 
agency? . No ...If .yes , please attach report to this form. 
TESTING INFORMATION . ... . \.y 

. INTELLIGENCE TESTS ( Individual or Group ) 

Date Test Grade when given CA MA IQ. ..Other Results 

69 • Pea- 2nd - 0 5-7 - 70 

' body • ' ' .. . 



...... Lr.V ...... ACHIEVEMENT TESTS Other 

Test Grade when given Age Read. Level Arithi. Level Result s 

6U - Iowa - 1st - 7 Kg. 1 Kg.-fr - ■ 

7“ Iowa 3rd 9 1.7 1.8 



1 . 

2 . 

3. 



Make out. in duplicate. Send original, copy to Office of 
Pupil Personnel Services, Administration Building; :• 

•Use reverse side for -supplying, any additional information . 
Referral assigned t o 



(To be completed by Office of Pupil Personnel 

— 't+- t | 



Date 277 / 

»nnel Service) • 




APPENDIX B 

Examiner Questionnaire 



This data will be used only in the statistical analysis of the study 

Age Sex Highest professional degree 

Years Experience as Psychologist 

Approximate number of individual Intelligence tests administered 

in past year in lifetime 

What degree of accuracy would you attach to the IQ Score you obtained? 
within plus or minus 2.5 points 

•• n it ii g n ““ — 

» si ii *• ii 

•i ii n ii 25 *» 

more than " " *' 20 " 



Type of employment you now hold (i.e. school district, clinic, private 

practice, etc.) 

How would you approximate the racial proportion of the clients you evaluate 
(i.e. 60% white, 30% Black, 10% Mexican American, etc.) . . 



How would you rate your clinical skills in relation to others in the field 
in which you are employed? 

well above average 

above average 

slightly above average 

average 

slightly below average 

below average 

well below average 

relate your opinions regarding the use of video tape equipment 
for the purpose of training psychologists? ' 



in scoring individual IQ tests? 



Briefly relate your feelings about this study and/or the implications of it 



APPENDIX C 

ANOVA Tables For Subtests 
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SOURCE 



TOTAL 

Between Subjects 

Race _ of. Examiner • 

Error, 

b 

Within Subjects 
Race of Subject 
Expectancy - 

Race of Examiner x 
; Race, of Subject 
Race of Examiner X 

, Expectancy r 

Race of Subject X 
Expectancy 
Race of Examiner X 
Race of Subject X 
Expectancy 
Errorj 
Error2 
Error^ 



....... 



- Information 



SS df ms F P 



27. 


- 63 


„ 






■ ' 2.5 


15 


■■ 




■ - " 


.5625 C 


1 


.5625 


4.0643 


<.10 


i' 1.937*5 


14 


.1384 
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A 24.5 


:48 








14.0625 


1 


14.0625 89.9712 


(.001 


.5625 - 


1 


.5625 


3,5988 


<.10 


.25 


1 


.25 


1.5995 


ns 


.25 


1 


.25 


.9491 


ns 


.0 . . • 


1 


0. 


0. 


ns 


.5625 


1 


A . ; 

.5625 


2.6811 


ns 


2.1875 


14 


.1563 




— 


, 3.6875 : 


14 


.2634 




«» 


2.9375 f 


14 


.2098 


— ■ • 
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{ 



Comprehension 



SOURCE SS df ms F 



TOTAL 


271.75 


63 








Between Subjects 


50.25 


15 


— 


.> '• ' 'mm ‘ V 


«. . 


Race of Examiner 


! 7 ; 5625 


1 


7.5625 


2:4802 


— 


Error^ 


42 .'6875 


14 


3.0491 


- 




Within Subjects 


221.5 


48 




p| 




Race of Subject 


90.25 ‘ 


1 


90.25 


31.0532 


<001 


Expectancy 

Race of Examiner X 


6.25 


1 


6.25 


2.5225 


ns 


Race of Subject 
Race of Examiner g 


10.5625 


1 


10.5625 


3.6343 


<.10 


Expectancy 
Race of Subject x 


7.5625 


1 


7.5625 


3.0522 


na 


Expectancy 
Race of Examiner X 
Race of Subject X 


1.0000 


1 


1.000 s 


.46 


ns 


Expectancy 


.0625 


1 


.0625 


.0287 


ns 


Error^ 


40.6875 


14 


2.9063 






Error 2 


34.6875 


14 


2.4777 


- ' 


— 


Error 3 


30.4375 


14 


2.1741 




- 
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Arithmetic 



SOURCE 


SS 


df 


ms 


F 


P 


TOTAL 


63.734 


•63 








Between Subjects 


15.484 


15 


- 


.. 




Race of Examiner 


2.640 


1 


2.64 


2.879 


ns 


Error^ 


12.844 


14 


.917 


- . 




Within Subjects 


48.25 


48 




■*' "• Mi' 


^ ■ 


Race of Subject 


1.265 


1 


1.265 


1.379 


ns 


Expectancy 
Race of Examiner X 


1.40 


1 


1.4 


.974 


ns 


Race of Subject 
Race of Examiner X 


2.64 


1 


2.64 


i 2.879 


ns 


Expectancy 
Race of Subject X 


4.517 


' 1 


4.517 


3; 141 


do 


Expectancy 
Race of Examiner X 
Race of Subject X 


.142 


1 


.142 


.966 


ns 


Expectancy 


4.513 


1 


4.513 


30.101 


<.001 


Error ^ 


12.843 


14 


.917 


mm ‘ ■ 




Error £ 


20.127 


14 


1.438 


- ■ 


— 


Errorl 


2.061 


14 


.147 




- 



Similarities 



SOURCE 


SS 


TOTAL 


145.984 


Between Subjects 


i , 734 


Race of Examiner 


.015 


Error. 

D 


.719 


Within Subjects 


145; 25 


Race of Subject ; v 


141.015 


Expectancy 


.015 


Race of Examiner X 




Race of Subject 


.142 


Race of Examiner X 




Expectancy 


.142 


Race of Subject X 




Expectancy 


. .392 


Race of Examiner X 




Race of Subject X 




Expectancy 


.138 


Errorj. 


M.593? 


Error 2 


1.593, 


Error g 


1.22 



' df ms F p 



■; 63 








15 


- 


- *■ 




'> : 1 


.015 


.2918 


ns 


14 


.0514 


- 


- 


48 


_ 


- ■ — * 


, ■■ _ r 


' ;i 


141.015 3325; 8255 


:<. 00001 


.1 


.015 


.1318 


ns 


l 


.142 


3.3491 


(•10 


. l 


.142 


1.2478 


ns 


<\ l 


.392 


4.5006 


(iO 


, 1 


.138 


1.5844 


ns 


14 


.0424 






:i4 


.1138 


' 


■«. 


14 


.0871 




- 



Vocabulary 



SOURCE 


SS 


df 


ms 


F 


P 


TOTAL 


226 


63 








Between Subjects 


30 


15 


- 


- 


- 


Race of Examiner 


6.25 


1 


6.25 3 


.6843 


<.10 


Error. 

D 


23.75 


14 


1.6964 


- 


- 


Within Subjects 


196 


48 


mm 


. 




Race of Subject 


100 


1 


100. 41 


.4817 


(.001 

ns 


Expectancy 


. .0625 


1 


.0625 


.0332 


Race of Examiner X 
Race of Subject ' 


2.25 


1 


2.25 


.9333 


ns 


Race of Examiner X 
Expectancy 


1.5625 


1 


1.5625 


.8294 


ns 


Race of Subject X 
Expectancy . : 


.5625 


. 1 


.5625 


.2510 


ns 


Race of Examiner X 
Race. of Subject X 
Expectancy 


.0625 


1 


.0625 


.0279 


ns 



Error. 

Error^ 

Error^ 



33.75 

26.375 

31.375 



14 2.4107 
14 1.8839 
14 2.2411 



Digit Span 



SOURCE 


SS 


df 


ms F 


P 


TOTAL 


23.9755 


63' 






Between Subjects 


4.9375 


15 


— — •' 




Race of Examiner 


.0625 


1 


.0625 .18667 


ns 


Errors 


4,6875 


14 


.33482 - 


- 


Fithin Subjects 


19.038 


48 






Race of Subject 


.0625 


1 


.0625 .14737 


ns 


Expectancy 

Race of Examiner X 


1.5625 


• V 1 


1.5625 4.92964 


\.05 


Race of Subject 
Race of Examiner X 


1.00 


1 


1.00 2.35788 


ns 


Expectancy 
Race of Subject x 


1.00 


: 1 


1.00 3.15497 

l '■ ■ ’ *: 


<.10 


Expectancy 
Race of Examiner X 


.5625 


1 


.5625 1.86369 


ns 


Race of Subject 


X 








Expectancy 


.25 


1 . 


.25 .82831 


ns 


Error j 


5.9375 


14 


.42411 




Error2 


4.4375 


14 


.31696 




Error. 


4.2255 


14 ' 


.30132 


- 



Picture Completion 



SOURCE 


SS 


df 


ms 


F 


P 


TOTAL 


431.2344 


63 








Between Subjects 


22.4844 


15 


- 


. — # 


- 


Race of Examiner 


.1407 


1 


.1407 


.0882 


ns 


Error^ 


22.3436 


14 


1.5960 


- , 


- 


Within Subjects 


408.75 


48 






. _ 


Race of Subject 


301.8907 


1 


301.8907 


144 .0318 


<.001 


Expectancy 


.0157 


1 


.0157 


.0056 


ns 


Race of Examiner ! 


X 




< 






Race of Subject 


.0155 


1 


.0155 


.0074 


ns 


Race of Examiner ' 


X 










Expectancy 


.0155 


1 


.0155 


.0055 


ns 


Race of Subject X 












Expectancy 


2.6405 


1 


2.6405 


1.0424 


ns 


Race of Examiner ! 


X 










Race of Subject 


X 










Expectancy 


.1408 


1 


.1408 


.0556 


ns 


Error 


29.3438 


14 


2.096 






ErrorJ 


39.2188 


14 


2.8013 


- 


- 


Error j 


35.4624 


14 


2.533 




- 
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SOURCE 



Pictur e ’ Arrangement 
SS df ’ • ms F 



TOTAL 34 

Between Subjects . 5.5 

'Race of Examiner 0.0 

Error fc .5.5 

Within Subjects , .. .. 28.5 

Race of Subj ect . 9 
Expectancy .0625 

Race pf. Examiner X 
Race of Subject 0. 

Race of Examiner X 

Expectancy .0625 

Race of Subject x , 

Expectancy .0625 

Race of. Examiner X 
Race of Subject X 
Expectancy 1.5625 

Error 2.5 

Error! 4.375 

Error* 10.875 



63 


- 


- 


- 


15 




; ; - 


- 


1 


0. 


o. ‘ '• 


ns 


14 


.3929 




- 


48 








1 


9 : 


50:. 005 


<.001 


1 


.0625 


.2 ; 


ns 


1 


0 


0.0 


ns 


1 


.0625 


.2 


ns 


1 


.0625 


7-9-5 


ns 



i 


1.5625 2.0115 


ns 


14 


.1786 , - 




14 


.3125 


- 


14 


.7768 - 








43 



Block Design 



SOURCE 


SS 


df 


ms 


F 


P 


TOTAL 


30.109 


63 








Between Subjects 


.4.359 


15 


- 


— 


- 


Race of Examiner 


.015 


i 


.015 


.048 


ns 


Error, 

D 


4.344 


14 


.31 


- 


- 


T-Tithin Subjects 


25.75 


48 


— 






Race of Subj ect 


13.14 


-1 


13.14 


94.5324 


<•001 


Expectancy 


.39 


■' 1 •. 


.39 


1.2226 


ns 


Race of Examiner X. 










Race of Subject 


;017 


1 


.017 


.0769 


ns 


Race of Examiner X 




•i ' •••. 






Expectancy 


.392 


1 


.392 


1.2288 


ns 


Race of Subject X 












Expectancy 


.142 


1 


.142 


.500 


ns 


Race of Examiner X 








. . • • ■ ..... 




Race of Subject X 








• 


Expectancy 


.138 


1 


.139 


.489 


ns 


Error ^ 


3.093 


14 


.221 






Error 2 


4.468 


14 .! 


.319 




- 


Error^ 


3.970 


14 H 


.284 




- 



Object Assembly 



SOURCE 


SS 


df 


ms 


F 


P 


TOTAL 


188.859 


63 








Between Subjects' ' 


6.609 


15 


- ■ 






Race of Examiner 


.39 


1 


.39 


.8780 


ns 


Error^ 


6.219 


14 


.4442 


- 


- 


Within Subjects 


182.25 


48 


«• 


- ^ . 




Race of Subject 


141.015 


1 


141.015 


104.0778 


<■.001 


Expectancy 
Race of Examiner J 


1.89 

f 


1 


1.89 


2.5278 


ns 


Race of Subject 
Race of Examiner J 


.767 

P 


1 


.767 


.5661 


ns 


Expectancy 
Race of Subject" X 


.392 


1 


.392 


.5243 


ns 


Expectancy 
Race of Examiner J 


.392 

P 


1 


.392 


.6677 


ns 


Race of Subject 


X 










Espectancy 


.133 


1 


.138 


.2351 


ns 


Error. 


18.968 


14 


1.3549 






Errorj; 


10.468 


14 


.7477 


*: - . 


— 


. Error j 


8.22 


14 


.5871 


- 


- 
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Coding 



TOTAL 


SS 


df 


tns 


F 


P 


TOTAL 


236.9375 


63 


. 






Between Subjects 


28.4375 


15 


- 


— 


- 


Race of Examiner 


.0625 


1 


.0625 


.0308 


ns 


Error 

b 


28.3750 


14 


2.0268 


- 


« 


Within Subjects 


208.5 


48 








Race of Subject 


132.25 


1 132.25 


76.3524 


.001 


Expectancy 


6.25 


1 


6.25 


5.3437 


.05 


Race of Examiner 


X 










Race of Subject 0.00 


1 


0.00 


0.0 


ms 


Race of Examiner 


X 










Expectancy 


5.875 


1 


5.875 


5.0231 


.05 


Race of Subject X 










Expectancy 


.0625 


1 


.0625 


.0389 


ns 


Race of Examiner 


X 










Race of Subject X 










Expectancy 


.9375 


1 


.9375 


.5833 


ns 



46 



